Safe Baby AGI

نویسندگان

  • Jordi Bieger
  • Kristinn R. Thórisson
  • Pei Wang
چکیده

Out of fear that artificial general intelligence (AGI) might pose a future risk to human existence, some have suggested slowing or stopping AGI research, to allow time for theoretical work to guarantee its safety. Since an AGI system will necessarily be a complex closed-loop learning controller that lives and works in semi-stochastic environments, its behaviors are not fully determined by its design and initial state, so no mathematico-logical guarantees can be provided for its safety. Until actual running AGI systems exist – and there is as of yet no consensus on how to create them – that can be thoroughly analyzed and studied, any proposal on their safety can only be based on weak conjecture. As any practical AGI will unavoidably start in a relatively harmless baby-like state, subject to the nurture and education that we provide, we argue that our best hope to get safe AGI is to provide it proper education.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Responses to catastrophic AGI risk: a survey

Many researchers have argued that humanity will create artificial general intelligence (AGI) within the next twenty to one hundred years. It has been suggested that AGI may inflict serious damage to human well-being on a global scale (‘catastrophic risk’). After summarizing the arguments for why AGI may pose such a risk, we review the fieldʼs proposed responses to AGI risk. We consider societal...

متن کامل

Inferring Human Values for Safe AGI Design

Aligning goals of superintelligent machines with human values is one of the ways to pursue safety in AGI systems. To achieve this, it is first necessary to learn what human values are. However, human values are incredibly complex and cannot easily be formalized by hand. In this work, we propose a general framework to estimate the values of a human given its behavior.

متن کامل

Universal Empathy and Ethical Bias for Artificial General Intelligence

Rational agents are usually built to maximize rewards. However, AGI agents can find undesirable ways of maximizing any prior reward function. Therefore value learning is crucial for safe AGI. We assume that generalized states of the world are valuable – not rewards themselves, and propose an extension of AIXI, in which rewards are used only to bootstrap hierarchical value learning. The modified...

متن کامل

Water quality and Inuit health: an examination of drinking water consumption, perceptions, and contamination in Rigolet, Canada

Canadian Inuit have often reported concerns about the quality of their municipal drinking water; research has also shown that some Inuit communities experience some of the highest incidence rates of self-reported acute gastrointestinal illness (AGI) in Canada and globally. The goal of this thesis research was to investigate drinking water perceptions and consumption patterns, as well as water c...

متن کامل

Whole Cell Therapeutic Vaccine Modified With Hyper-IL6 for Combinational Treatment of Nonresected Advanced Melanoma

UNLABELLED Active specific immunotherapy of cancer requires an efficient induction and effector phase. The induction covers potent activation of anti-tumor response, whereas effector breaks the immunosuppression. We report efficacy of therapeutic melanoma vaccine (AGI-101H) used alone in advanced disease as a candidate for further combined treatment. In adjuvant setting in patients with resecte...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015